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ABSTRACT 

The equipercentile assumption states that students in 
traditional classrooms «ho receive no other instructional assistance, 
will maintain their relative rank order over time. To test this 
assumption, fall to fall test results on the SPA Achievement Tests 
were obtained for grades 2-3, and 6-7. Total reading and total 
mathematics arowth scale values were used in all analyses- Score 
distributions were divided into low, medium, and high subgroups of an 
approximately equal number of matched scores. With the exception of 
grades 7-9 mathematics scores, the equipercentile assumption was 
valid only for certain subgroups, not for the total group. These 
results conflicted with those of a similar study the previous year, 
providing less than a harmonious picture of the equipercentile 
assumption. Districts considering Title I evaluation model A should 
conduct a local study of non- federally impacted children to determine 
for themselves the appropriateness of the assumption. (CP) 
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ABSTRACT 



The purpose of this study is to further 
examine the tenability of the equipercentile assumption 
as applied to standardized achievement tests. This 
assumption simply states that standardized achievement 
tests are so designed that students in traditional 
classroom instructional settings, who receive no other 
instructional assistance, will maintain their relative 
rank order over time. 

The apparent value of such an assumption, if 
valid, is that it is possible, w#thin certain limits, 
to use the norming group associated with a specific 
standardized test as a pseudo-control group in 
evaluation studies. This eliminates the need for a 
locally-selected control group and offers instead, 
the use of the pretest mean as the control parameter 
estimate in a one-group pretest/posttest design. 
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INTRODUCTION 

With the advent of the 1974 congressional mandate 
regarding Title I evaluation, RMC Research Corporation 
was given the task of developing alternative models for 
Title I evaluation. Among the models chosen by RMC was 
the one-group pretest/posttest design described by Campbell 
and Stanley (1962) . Tallmadge and Wood (1976) refer to 
this design as Model A. The new wrinkle, of course, was 
the introduction of an implied control group and the equi- 
percentile assumption. It did not take long after the 
release of the models suggested by RMC for Model A to 
become the most popular model. Unfortunately, the choice 
of Model A has been based most often on convenience and 
ease of implementation, rather than on any sound empirical 
support for the validity of the model. 

To date there has been little documented evidence 
to support or refute the equipercentile assumption. One 
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data-based study with reasonable sample sizes was 
conducted by the present authors in 1979 (Powell, et al, 
1979) . In this study, pretest and posttest data was 
obtained from a local school for grades 3, 4, and 5 with 
sample sizes ranging from 136 to 183. The results of this 
study suggested some degree of inconsistency, since the 
equipercentile assumption appeared to hold in general for 
reading but not for mathematics. 

There are two primary drawbacks to this preliminary 
study. First, the form and level of the test was not 
constant from pretest to posttest. Since difficulty 
increases with changes in level, RMC recommended maintaining 
the same level and form for pretest and posttest when using 
Model A. It seems reasonable then, to expect a different 
result when the same level is maintained over a period of 
time. The second drawback was the omission of the lower 
and upper ten percent of the distrioution. It was assumed 
that extreme scores (especially low scores) were prone to 
considerable measurement error and that the regression 
effect would result in low pretest scores increasing at 
posttest time by chance alone. However, Tallmadge (1976) 
clearly notes that if student selection is independent of 
the pretest, then regression toward the mean will not occur. 
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The present study examines the equipercentile 
assumption when following all of the recommended procedures 
for implementing Model A. Tests are administered at the 
proper norming date and for purposes of this study, the 
children are selected because of their lack of involve- 
ment in Title I or other federal programs that should 
influence normal school year growth. The same level 
of the test is administered at pretest and posttest time. 



METHODS 

Data were collected from a local school district 
with an average daily attendance of approximately three 
thousand children in grades one through twelve. Fall- 
to-Fall test results were obtained for the 1976-77 school 
year for grades two to three and for the 1977-78 school 
year in grades six to seven. No students involved in 
any federal programs were used in this study. 

The total reading and total math growth scale 
value scores from the SRA Achievement Test were used in 
all analyses. Children's pretest and posttest scores were 
matched separately for reading and for mathematics. At 
grades two to three, there were 104 matched pairs of scores in 
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both reading and mathematics. At grades 6 to 7, there 
were 139 matched pairs of scores for both reading and 
mathematics. It should be noted that there were no special 
reading or mathematics programs involved; hence, there 
v/as no reason to believe that the equipercentile assumption 
would not hold across the entire range of students. 

The range of actual scores obtained and used in 
the data analysis were between the second and ninety-ninth 
percentile in reading, and between the sixth and ninety- 
ninth percentile in mathematics at the second grade level. 
At the sixth grade level, the range of actual scores were 
between the fifth and ninety-sixth percentile in reading 
and between the second and ninety-ninth percentile in 
mathematics. 

In order to determine the extent to which the equi- 
percentile assumption held throughout the entire test score 
distribution, the distribrtion for total reading and total 
math was divided into thirds. In this way, it was hoped 
that any systematic deviations in the equipercentile 
assumption could .:>e isolated according to the initial level 
of pretest score. 

Since growth scale values (GSVs) are not expected 
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to remain constant from pretest to posttest, the mean 
growth scale value for pretest and posttest was converted 
to percentiles and then to Normal Curve Equivalents (NCEs) . 
If the equ percentile assumption held, then the NCE means 
would be constant from pre to posttest time. A T-test 
for paired data was used to determine any significant 
departure from a zero expectation for all sub-groups and 
total groups. 



RESULTS 

I, End of Grade Two to End of Grade Three Analysis 

Figures 1 and 2 represents the frequency 
distribution of scores in GSV values for both 
total reading and total mathematics for the end 
of second grade scores. Based on these pretest 
distributions, subjects were divided into three 
categories: low, medium, and high. Categories 
were determined so that each category would 
have an approximately equal number of matched 
scores. Figure 3 shows the summary information 
for the total reading scores for both pre and 
posttest. A quick glance at the boxes in Figure 3 
indicates that the equipercentile assumption does 
not appear to be met for the total group or for 
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the lower two groups; however, for the upper 
group — with thirty-six subjects — there is 
a very close match of ninety-three percentile 
for an average on pretest, and a ninety-four 
percentile for average on posttest. Figure 4 
shows similar summary information for total 
mathematics scores. In this case it is the low 
group — with thirty-eight matched subjects — 
that shows a very close adherence to the equi- 
percentile assumption with those thirty-eight 
children approximating the thirtieth percentile 
on both pretest and posttest. 

Figure 9 presents the necessary information to 
perform a T-test for matched scores and roughly 
agrees statistically with the "eyeball" observations 
above. For the reading achievement between second 
and third grade, both the low and high sub-groups 
are not significantly different from a theoretical 
expectation of the equipercentile assumption. 
Likewise, in mathematics achievement between the 
second and third grade, the low and medium groups 
of stude ts are not statistically different from 
our equipercentile assumption (p <.05). Note that 
the population value y pre and p post are ob- 
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tained by first obtaining the median for the 
total group and then each of the three sub-groups 
on the pretest, and translating those percentile 
values to equivalent growth scale values using 
posttest norms. 

Analysis of Grades Six and Seven Results 
Figures 5 and 6 show the frequency distributions 
for the end of grade six; that is, the pretest for 
both total reading and total T^athematics scores. 
As in the grade two to three analysis, students' 
scores were further subdivided into three sub- 
groups — low, medium, high — which had approxi- 
mately equal and/or matched scores. The range for 
each sub-group is given in Figures 5 and 6. 
Summary statistics for total reading at the sixth 
to seventh grade level is presented in Figure 7. 
The equipercentile assumption does not seem to 
hold up well for the total group, or any of the 
three sub-groups, although it is much closer at 
the sixth to seventh grade level than it was at 
the second to third grade level. 

Figure 8 presents the results in summary statistics 
for total mathematics scores. The equipercentile 
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assumption is a closer approximation for the 
overall matched group, going from the fifty-eighth 
to the sixtieth percentile from pre to posttest. 
It is a good match for the low group, going from 
the twenty-seventh to twenty-ninth percentile 
pre to post. It is a good match for the high 
group, going from the eighty-eighth to the 
eighty-sixth percentile pre to post. And even 
for the middle group, there does not seem to be 
that much difference pre to post as far as an 
"eyeball" analysis goes. However, information on 
Figure 9 shows that three of the four comparisons 
for reading at the sixth to seventh grade level 
are statistically significants at the (p<.05) level. 
However, none of the differences between obtained 
and expected growth scale score values on total 
mathematics scores are significantly different, 

III. Discussion 

The results of a similar study last year by the 
authors (Powell et al, 1979), indicated that, 
using 'a similar analysis, the equipercentile 
assumption seemed to hold for both the overall 
group and the individual low, medium, and high 
sub-groups for total reading scores for grades 
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two to three, grades four to five, and over a 
two-year analysis, grades two to four. At the 
same time, the equipercentile assumption, in 
gener^al, did not hold for the total mathematics 
score for either the total group or the individual 
sub-groups. Comparing last year's data taken 
from another school district with this year's data, 
indeed, provides less than a harmonious picture 
of the potential of the equipercentile assumption. 

The best summary statement that might be culled 
from both of these studies is that the equi- 
percentile assumption may or may not be a good 
assumption, depending not only on the school being 
investigated but also, the test being used, the 
test: level and form use, and the children taking 
the test. 



A school district interested in using the Title I 
evaluation Model A would be well-advised to do a similar 
study of non-federally impacted children in its' local school 
district to see the extent to which it can put its faith in 
this vital assumption behind Model A, the equipercentile 
assumption. 
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Using tests of significance we ?an find some sub- 
groups, and even some total groups, for which the Gquip.^ rcent? le 
assumption statistically holds true. However, if the equx- 
percentile assumption is to be taken at face value, we find no 
condition where precisely the same percentile for evc;n small 
groups of children is maintained from pretest to posttest 
under those conditions where the equipercentile assumption 
should obtain; that is, in situations where children are not 
impacted by other than ongoing school programs. 

SUPPLEMENTAL DAT A 

We have recently obtained information from a 
large city school district in the southwest that 
bears further on the problem of the equipercentile 
assumption. One of the author's concerns of both 
last year's study and this year's study is that 
the larger tht N size for groups of students, the 
more closely the equipercentile assumption will 
hold given that there is a sufficient number of 
children not impacted by federally-assisted 
programs. We were able to find approximately 
1,500 matched scores for both total reading and 
total mathematics achievement test scores in a 
school district using a Spring-to-Spring testing 
cycle with the ITBS, Level 7, Form 5. Students 
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were matched on pre and posttest scores and were 
chosen for their lack of federal program involve- 
ment. These children were tested at both the end 
of grade two and at the end of grade three using 
the same form and '.evel of the test during the 
1978-79 school cycle. Although the data is too 
recent for the necessary T-tests to have been 
used. Figure 10 indicates that neither for the 
total group for reading and mathematics, nor for 
the quarti|e of those groups, does the equipercentile 
assumption visually hold. Contrary to hoping 
that larger N size will smooth out the variance 
between the statistical and the visual presentation 
of the equipercentile assumption, in this one 
case, it does seem that larger N further 
dissipates any hope that the equipercentile 
assumption is a real and consistent phenomenon. 

c 

School districts using the Title I Evaluation 
Model A should be cautioned that prior to imple- 
menting the model, a small local study should be 
done so that they can ascertain for themselves the 
appropriateness of the equipercentile assumption. 
Where the equipercentile assumption cannot be met, 
one of the other two Title I Evaluation Models 
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might be contemplated, or an alternative model 
might be presented to USOE based on this and 

similar types of preliminary analysis. 

Work is currently being done by the RMC Research 
Corporation, under contract with the U. S. Office of Education 
Office of Evaluation and Dissemination, to use large scale 
data bases to investigate the validity of the equipercentile 
assumption. Hopefully, during 1980 more definitive guide- 
lines will be available on the parameters of the equipercentile 
assumption based on those large-scale data-based studies. 
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Pre test Distribution of GSV scores for End of Grade 2 
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FIGURE 2 

Pretest Distribution of GSV scores for End of Grade 2 
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FIGURE 3 



End of Grade 2, End of Grade 3 Summary Statistics 
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F I G U R E 4 



End of Grade 2, End of 
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FIGURE 5 

Pretest Distribution of GSV scores for End of »jraJc 6 
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FIGURE 6 18. 

Pretest Distribution of GSV scores for End of Grade 6 
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F I G.U R E 6 (continued) 
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FIGURE 7 



End of Grade 6, End of Grade 7 Summary Statistics: 
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FIGURE 8 

End of Grade 6, End of Grade 7 Summary Statistics: 

TOTAL MATH 
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Grade 2->S^ Sprinq-to-Spring, ITBS, Level 7, Form 5 
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Pre Post Pre Post 

%lle %ile %ile %ile 

12.20 15.11 12.27 14.30 

(S.D.) (9.19) (14.92) (12.84) (16.57) 



Quartile 2 

N = 377 N = 357 

Pre Post Pre Post 

%ile %ile %ile %ile 

46.42 30.98 23.64 29.61 

(S.D.) (7.24) (19.57) (15.60) (23.07) 

Quartile 3 

N = 426 N = 422 

Pre Post Pre Post 

%ile %ile %ile %ile 

67.77 51.85 35.02 48.35 

(S.D.) (5.65) (?'1.78) (19.23) (25.58) 

Quartile 4 

N = 343 N = 340 

Pre Post Pre Post 

%ile %ile • %ile %ile 

86.40 75.70 52.42 69.84 

(S.D.) (5.73) (18.54) (19-52) (22.75) 

ERIC ^ — PowBLL Associates* Inc. 



FIGURE 10 



t-test for Matched Scores 



23 



GROUP 



X PRE X POST 



yPRE 



ViPOST r PRE-POST Sxpp 



2nd 
3rd 



2nd 
3rd 



6th 
7th 



6th 
7th 



Total 
Low 
Med 
High 

MATH 

Total 
Low 
Med 
High 



READING 

Total 
Low 
Med 
High 

MATH 

Total 
Low 
Med 
High 



197 
147 
195 
247 



164 
138 
161 
196 



355 
308 
356 
395 



362 
305 
358 
430 



260 
219 
262 
297 



200 
177 
196 
232 



389 
348 
384 
429 



397 
336 
398 
461 



182 
112 
192 
263 



186 
130 
161 
219 



326 
274 
355 
408 



388 
274 
357 
471 



234 
170 
245 
311 



236 
167 
203 

277 



352 
300 
377 
433 



422 
297 
389 
510 



.72 
.51 

0 

.26 



.73 
.47 
.17 
.61 



81 
54 
17 
51 



82 
42 

.44 

,60 



3.50 
7.06 
4.54 
4.95 



2.50 
4.12 
4.39 
4.84 



2.28 
4.46 
4.31 
3.08 



3.16 
6.10 
4.08 
6.60 



+3.14* 
+1.98 
+3.08* 
+0.40 



-5.60* 
+0.49 
-1.59 
-4.55* 



+3.51* 
+3.14* 
+1.39 
+2.92* 



+0.32 
+1.31 
+1.96 
-1.21 
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